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Abstract 

Background'. Passive smoking has been found to be a respiratory health hazard in humans. The present study describes the 
calculation of a reference interval for urinary nicotine metabolites calculated as cotinine equivalents on the basis of 72 
non-smokers exposed to tobacco smoke less than 25% of the day. Methods'. Twenty subjects (passive smokers) exposed to 
tobacco smoke more than 25% of the day (subjectively assessed) and 32 smokers were used to validate the estimated 
reference interval. Urine samples were collected three times during the day approximately at 06.30, 17,00 and 22.45 h. 
Results: Within-subject variation was found to be 89.4, 72.6, and 79.2% and between-subject variation was found to be 64.5, 
64.2, and 36.1%. No gender difference could be demonstrated. In general all subjects showed increased concentrations in the 
afternoon and evening samples compared to the morning samples. Parametric reference interval for excretion of nicotine 
metabolites in urine from non-smokers was established according to International Union of Pure and Applied Chemistry 
(IUPAC) and International Federation for Clinical Chemistry (1FCC) for use of risk assessment of exposure to tobacco 
smoke- The reference interval for urinary cotinine was estimated to be 1.1-90.0 pmol/mol creatinine in morning samples 
from non-smokers. An intercomparison between the radioimmunoassay (RIA) method used for determination of nicotine 
metabolites and a gas chromatography-mass spectrometry (GC-MS) method for determination of cotinine was carried out 
on 27 samples from non-smokers and smokers. Results obtained from the RIA method showed 2.84 (confidence interval 
(Cl); 2.50; 3.18| times higher results compared to the GC-MS method. A linear correlation between the two methods was 
demonstrated (p=0,96). Conclusion: The RIA method is rapid and adequate for clinical use in the assessment of exposure to 
tobacco smoke, i.e. ratio between CV a /CV„ was<0.50. © 2001 Elsevier Science B.V. All rights reserved. 


Abbreviations: AMIQAS, quality assurance software for method evaluation; COBAS Mira, a fully selective analyzer (Roche), for 
measurement of, e.g. creatinine; CV, coefficient of variation; CV„, CV between days; CV.„,, CV between days for determination of nicotine 
metabolites; CV. jri , CV between days for determination of creatinine; CV,, between-subject (within-group) variation; CV,,, within-subject 
variation; DEKS, Danish ekstemal quality system; DPC, diagnostic products corporation; I,, index of individuality; IFCC, International 
Federation of Clinical Chemistry; IUPAC, International Union of Pure and Applied Chemistry; LOD. limit of detection; P. population 
proportion; Vj, variance between-subjects; V„, total variance within-subjects including analytical variation 
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1. Introduction 

Passive smoking has been found to be a respirato¬ 
ry health hazard in humans. Previous studies have 
shown that children were more susceptible to de¬ 
velopment of asthma if exposed to passive smoking. 
Furthermore, adult non-smokers exposed to environ¬ 
mental tobacco smoke suffered to a larger extent 
from irritation of the eyes and respiratory tract (for 
review see [1]). More than 4000 compounds have 
been identified in tobacco smoke of which nicotine is 
the principal alkaloid. The main metabolites of 
nicotine are cotinine, mmj-3'-hydroxycotininc, 
rrans-3'-hydroxycotinine glucuronide, nicotine-l'-JV- 
oxide, and 3-pyridylcarbinol. Cotinine and trans-S'- 
hydroxycotinine are the major metabolites of nico¬ 
tine in humans [2]. Urinary cotinine reflects the 
serum concentration of cotinine measured in non¬ 
smoking subjects [3] and has frequently been used as 
a biomarker for exposure to environmental tobacco 
smoke [4—7]. The detection window often referred as 
half-life of cotinine in urine was found to be 18-20 
h, which makes it an appropriate biomarker of 
exposure to tobacco smoke compared to nicotine 
with a detection window of 1-2 h [2,8]. 

Polyclonal antibodies used in immunoassays for 
nicotine metabolites, e.g. RIA, react with other 
nicotine metabolites than cotinine [9], e.g. 3-hy- 
droxycotinine and 3-hydroxycotinineglucuronide, 
which results in higher concentrations compared to 
chromatographic methods for determination of 
cotinine [10]. Cross-reactivity to nicotine in im¬ 
munoassays is, however, very low. The main advan¬ 
tages of immunoassays are low sample-volume-re¬ 
quirements, little sample manipulation, and rapidity 
of analysis. Chromatographic methods are more 
specific but often time consuming, whereas RIA 
requires the use of costly reagents. Hence, RIA is in 
most instances considered an appropriate alternative 
to assess the total exposure to environmental tobacco 
smoke. 

Whenever analytical results serve as baseline data 
for evaluation of health risk in relation to exposure to 
passive tobacco smoke it is essential to estimate 
reference values of healthy non-smoking subjects. 


The estimation of reference levels in reference 
populations has been actively studied in the past 
decade [11-13], It has been discussed how to 
validate the normal values in situations where a 
number of results are low and several of the results 
are below the detection limit [14], Mean value, 
median, and range can not be reliably calculated 
when the numbers of measurements are few. Conse¬ 
quently, the International Federation of Clinical 
Chemistry (IFCC) and the International Union of 
Pure and Applied Chemistry (1UPAC) recommend 
specific statistical methods for establishing reference 
intervals [15]. 

The purpose of the present study was to establish a 
reference interval for urinary nicotine metabolites in 
non-smokers with self-reported exposure to passive 
tobacco smoke less than 25% of the day. Further, it 
was the purpose to provide data on biological 
variation including variation within and between- 
subjects and diurnal variation for urinary nicotine 
metabolites in healthy working active subjects. 


Forty-two healthy males and 86 healthy females 
comprised the study group. For estimation and 
validation of a reference level for a non-smoking 
population, 20 males and 52 females exposed to 
cigarette smoke less than 25% of the day were used. 
The rest of the study group included nine smoking 
males and 23 smoking females and 21 passive 
smokers (10 males and 11 females) exposed to 
cigarette smoke from colleagues or housemaids more 
than 25% of the day. Three former smoking males 
were exposed to cigarette smoke less than 25% of 
the day. On the day of urine sampling the particip¬ 
ants answered a questionnaire on individual charac¬ 
teristics including chronic diseases and medication. 
Demographic data are given in Table 1. All subjects 
gave informed consent and the local ethics commit¬ 
tee approved the study to comply with the Helsinki 
declaration. For method comparison between the 


2. Materials and methods 

2. 1. Study group 
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Table i 


Demographic (lata of the study group 



Males 

Females 

Number of subjects 

42 

86 

Number of 



Smokers 

9 

23 

Passive smokers 

10 

11 

Non-smokers 

23 

52 

Mean 

Age (years) 

45 

44 

Range (years) 

30-59 

30-59 


RIA method and the GC-MS method, 27 randomly 
selected urine samples from a German population 
were analyzed (10 male smokers, 17 male nonsmok¬ 
ers according to their self-reports, aged 29-60 
years). 

2.2. Collection of urine samples 

Urine samples were collected in plain tubes three 
times during a working day in November and 
December 1998. The first sample was collected in 
the morning, the second sample at the end of a 
working day, and the last sample before bedtime. To 
standardize results creatinine was measured in urine 
U6]. 

2.3. Chemical analysis 

The assay used for determination of nicotine 
metabolites in urine was a competitive RIA (Coat-a- 
count kit) purchased from DPC (Diagnostic Products 
Corporation, Los Angeles, CA). The cross reac¬ 
tivities of the antiserum used were tested for nicotine 
to be 2.7% at >620 pmol/l and for 3-OH-cotinine to 
be 15.2% at 6 jxmol/1 and 55.4% at 57 p.mol/1. A 
1470 Wizard gamma counter (Wallac, Turku. Fin¬ 
land) was used for measurement of radioactivity. The 
creatinine method was based on Jaffe’s reaction [16] 
and measured on a COBAS Mira autoanalyzer 
(Roche Diagnostic System, Basel, Switzerland). The 
GC-MS method for cotinine is modified after a 
procedure by Sharping et al. [17,18]. Briefly, urine is 
extracted with dichloromethane. The organic solvent 
is evaporated with gaseous nitrogen and the residue 


is dissolved in toluene. Cotinine is analyzed with a 
mass selective detector after capillary gas chromato¬ 
graphic separation. Deuterated cotinine is used as an 
internal standard. Calibration is performed with 
aqueous standards that are submitted to sample 
treatment as the urine samples are. Coefficients of 
variation ranged between 0.6 and 8.1% (n=10; at 
90-5460 nmol/I). Recovery rates were found be¬ 
tween 99.7 and 103.2% with a detection limit of 5.7 
nmol/1 [19]. 

2.4. Method performance 

The analytical method for determination of 
creatinine and the RIA method for determination of 
cotinine have been evaluated by a method evaluation 
function design according to Christensen et al. to 
estimate random and systematic effects [20], The 
method evaluation function was based on a linear 
least square regression analysis of the measured 
concentration versus the conventional true concen¬ 
tration of a series of method evaluation samples 
containing the analyte in the linear range of the 
method. The detection limit (LOD) was determined 
according to IUPAC as the mean+3S.D. of 20 urine 
samples at a low concentration [21], 

2.5. Performance of the analyses 

Samples for the method evaluation were prepared 
by spiking pooled urine samples from a non-smoking 
subject with the stock solution of cotinine ((purity 
>98%) obtained from Sigma, St. Louis, CA). The 
background level of the pooled urine samples was 
below the detection limit and the upper limit of the 
analytical range was 86 000 nmol/I. The RIA meth¬ 
od showed a proportional bias of 3%, i.e. the slope 
was found to be 1.03 [1.01; 1.05], whereas no 
systematic effect could be demonstrated, i.e. the 
intercept was found to be -1.47 1-39.3; 36.3], The 
between day variation (CV cot ) was estimated for to 
be 6% for smokers and 26.4% for non-smokers and 
passive smokers. LOD was estimated according to 
IUPAC to be 45 nmol nicotine, metabolites/1. 

For creatinine a Lyphocheck® calibrator from 
BIO-RAD laboratories GmbH (Munich, Germany) 
was used for the calibration of the analytical method. 
DEKS (Danish external quality system, Denmark) 


PM3006487199 


Source: https://www.industrydocuments.ucsf.edu/docs/fqhj0001 




i 28 


AM. Hansen et til. I Clinica Chimica Acta 304 (2001) 123-132 


intercomparison samples were used for preparation 
of method evaluation samples. The method for 
determination of creatinine showed a proportional 
bias of —2%, i.e. the slope was estimated to be 0.98 
[0.97; 1.001, no systematic effect could be demon¬ 
strated, i.e. —0.34 [-0.46; — 0.23J. The between-day 
variation (CV crca ) for creatinine measurements was 
2.3% in the whole range of the method. LOD was 
estimated to be 0.21 mmol creatinine/1. 

The total between-day variation, i.e., including 
within-day variation for the ratio between the 
cotinine and creatinine (denoted CV 3 ) was calculated 
by cv a =Vcv^,TCvL i , CV„ was calculated to be 
26.5% at levels for non-smokers and passive smok¬ 
ers and 6.4% at levels for smokers. The LOD for the 
ratio between cotinine and creatinine was estimated 
to be approximately 4.5 ■ punol cotinine/mol 
creatinine when using a mean creatinine excretion of 
10 mmol creatinine/1 urine. 


2.6. Quality assurance 

Commercial reference materials for cotinine in 
synthetic urine (controls in two levels from DPC 
(Los Angeles, CA» and creatinine (Lyphochek® 
Quantitative Urine Control Normal (1) and 
Lyphochek"' Quantitative Urine Control Abnormal 
(2) (Bio-Rad Laboratories, Munich, Germany)) were 
analyzed together with the samples. Westgard control 
charts were used to document that the analytical 
methods remained in analytical and statistical control 
i.e. the trueness and the precision of the analytical 
methods remained stable. The performance of the 
creatinine method was evaluated in the proficiency 
testing scheme (DEKS, Denmark). The target value 
used for the evaluation was established by DEKS 
using a high-performance liquid chromatography 
(HPLC) reference method. 

2.7. Statistics 

Statistical analysis was carried out by use of SAS® 
System™, version 6.12 (SAS Institute Inc., Cary, 
NC, USA). AMIQAS (Copenhagen, Denmark) was 
used for method evaluation and internal quality 
control [22], 


2.7.1. Statistical model 

The data were logarithmically transformed and 
analyzed using a variance component model with 
subject as random effects by use of the Mixed 
procedure in SAS® System™. Variance components 
describing variation bctween-subjects (V 6 ) and the 
total variation within-subjects (V^), i.e. variation 
within-subjects combined with analytical variation, 
were estimated. The latter includes unexplained 
variation. The index of individuality (/ ; ) was calcu¬ 
lated as CV ti /CV g [23], A variance component model 
to estimate effects of gender and age was performed 
using of the Mixed procedure in SAS® System™. A 
probability level of 0.05 was used as criteria for 
significance. Three outliers were excluded by use of 
Grubbs’ test for two outlying observations (P<0.01) 
followed by a Grubbs’ test for one outlying observa¬ 
tion (P<0.01) [24], 

2.7.2. Estimation of reference values for 
metabolites of nicotine in urine 

A parametric reference interval was used because 
the estimation is robust to deviations front the 
normal distribution of the measured results. Refer¬ 
ence limits corresponding to 0.95 and 0.05 fractiles 
of the distribution were established using the recom¬ 
mendations of the 1FCC [25J. IUPAC recommends 
the use of 95% coverage interval with a confidence 
level of 95% [Cl: 15] [26], and this interval was also 
calculated. No lower reference limit was reported if 
the 0.05 fractile fell below the detection limit. 


3. Results 

Demographic data of the study group is presented 
in Table 1. Twenty-seven urine-samples from smok¬ 
ers and non-smokers were analyzed for nicotine 
metabolites with the presented RIA method and 
compared to measurements of urinary cotinine using 
the GC-MS method (Fig. 1). The RIA method 
determined 2.84 [Cl: 2,50; 3.18] times more nicotine 
metabolites compared to the results from the GC- 
MS method of cotinine. A Pearson correlation analy¬ 
sis showed is. correlation coefficient of 0.96, One 
outlying observation was determined by a single 
Grubbs’ test and excluded. 

Table 2 presents the overall average of the ex- 
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Fig. 1. Intercompariscm between results obtained by RIA and 
GC-MS Results from 27 urine samples obtained with RIA 
(nicotine metabolites calculated as cotinine equivalents) compared 
to results obtained by GC-MS (cotinine). 

creted amounts of nicotine metabolites, CV a , CVj., 
CV S , CV a /CV li( and /, for non-smokers, passive 
smokers and smokers. The between-subject variation 
were for non-smokers, passive smokers, and smokers 
from 36.1 to 64.5% and smaller than within-subject 


variation found to be from 72.6 to 89.4%. Between- 
subject variation was lowest for smokers compared 
to passive and non-smokers. 

Table 3 presents a reference interval based on 
morning urine samples from 72 non-smoking sub¬ 
jects exposed to tobacco smoke for less than 25% of 
the day. Three former smokers excreted 10 to 30 
times higher concentration of nicotine metabolites 
compared to the remaining group of 72 subjects. The 
reference limits were calculated for nicotine metabo¬ 
lites in urine according to the procedures recom¬ 
mended by IFCC [25] and IUPAC [15,26], Con¬ 
centrations below LOD were given a value of a half 
of LOD (nicotine metabolite concentration in 10 of 
the samples was below LOD), but these values were 
only used for the IFCC calculations. The coverage 
uncertainty associated with the IUPAC coverage 
interval indicates the uncertainty of the reference 
limit, e g. a coverage uncertainty of [0.95±0.038]. 
This means that [1.1-94.9 p,mol cotinine/mol 
creatinine] covers an average of 95% of the non- 
smokers and it covers between 91.2 and 98.8% of the 
non-smoking population with a confidence of 0.95. 
The normalized sample values of the coverage 
interval for non-smokers in the morning samples 
were found to be normal distributed. The Lillyfors 


Table 2 

Analytical-, within- anti between-subject variation, CV 4 /CV„ and /, lor non-smokers, passive smokers, and smokers 



Group mean (daily excretion) [Cl] 
(ixmol cotinine/mol creatinine) 

c\ 

(%) 

cv„ 

(%) 

cv s 

(%) 

• cv/cv, 

/, 

Non-smokers (72) 

13.6 [1.9; 99.5] 

26.6 

89.4 

64.5 

0.30 

1.4 

Passive smokers (32) 

22.0 [3 6; 133 01 

26.6 

72.6 

64.2 

0.37 

1.2 

Smokers (21) 

1725 [339; 8775] 

6.0 

79.2 

36.1 

0.08 

2.2 


Table 3 

IFCC and IUPAC recommendations for estimating reference intervals for urinary nicotine metabolites in healthy subjects 


Number of samples 72 

Number of samples less than LOD 10 

Geometric mean (p.mol/mol creatinine) 10.! 

S.D. (pmol/mot crealinine) 3.1 

Range (p.rnolt'mol creatinine) 0.8—130.5 


IFCC 0.95 reference interval (p.mol/mol creatinine) 1.1-90.0 

0.90 confidence interval for reference limits (pmol/mol creatinine) {0.7; 1.6] -[62 1. 130.31 


IUPAC 0.95 Coverage interval (p.mol/mol creatinine) 1.1-94.9 

Coverage uncertainty, confidence 0.95 0.95 ± 0.058 
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Fig. 2. Excretion of nicotine metabolites in urine from smokers, passive smokers, and non-smokers. Excretion of nicotine metabolites 
calculated as p.mol cotinuie/mol creatinine in morning, afternoon, and evening urine samples from smokers, passive smokers, and 
non-smokers. Note: scale of ordinate is logarithmic. 


value for normality was 0.093 and the target value 
was 0.104. 

Fig. 2 shows the excreted amounts of nicotine 
metabolites for smokers (At =32), passive- (/V = 21), 
and non-smokers (N = 75) for three sample collection 
intervals (morning (05.45-07.15), afternoon (15.30— 
18.30) and evening (21.45-23.45)). Statistically 
significant difference between excretion of nicotine 
metabolites was found between passive smokers and 
non-smokers in samples collected during the after¬ 
noon. There was no difference in urinary excretion 
of nicotine metabolites during the morning and the 
evening. Urinary excretion of nicotine metabolites of 
smokers was observed to be approximately 100 times 
higher than observed for passive and non-smokers. 

4. Discussion 

In epidemiological and biomonitoring studies on 
exposure to occupational pollutants it may be im¬ 
portant to distinguish smokers from non-smokers. 
Evaluation of the toxic effects of occupational 
respiratory irritants requires the recognition of the 
smoking habits of exposed subjects. For this purpose 


measurements of urinary nicotine metabolites may be 
very useful to validate information collected by 
questionnaires. However, it is crucial to be aware of 
the discrepancy between results obtained from differ¬ 
ent analytical method for determination of exposure 
to passive smoke. In the present study a RIA for 
determination of nicotine metabolites was used. 
Comparison with results obtained by use of a GC— 
MS method for determination of urinary excretion of 
cotinine, the results obtained by the RIA method for 
determination of excretion of nicotine metabolites 
was approximately 2.8 times higher. Polyclonal 
antibodies used in immunoassays show cross-reac¬ 
tivity to other metabolites of nicotine, e.g. 3-hy- 
droxycotinine and 3-hydroxycotinineglucuronide [9J. 
The cross-reactivity of the antibody used to 3-hy- 
droxycotinine used in the RIA assay varied with the 
content. Hence the estimated ratio between GC-MS 
and RIA may differ more in measurement of urine 
from smokers compared to non-smokers. The corre¬ 
lation between the two methods was 0.96 indicating 
a good relation between concentration of cotinine 
and the sum of excreted nicotine metabolites. Ac¬ 
cordingly both methods may be equally applied for 
determination of smoking status. 
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Within-subject variation may be used to set ana¬ 
lytical goals for methods used for monitoring smok¬ 
ing status. In clinical settings it has been suggested 
that a desirable imprecision could be defined as 
CV„<0.5*CV,; and an optimum performance could 
be defined as CV a <0.25*CV li [27], In the present 
study CV a /CV u was less than 0.50 for the applied 
RIA method for determination of nicotine metabo¬ 
lites. Thus the analytical performance of the used 
RIA method was adequate for monitoring smoking 
status. 

The between-subject variation for nicotine metab¬ 
olites was 36.1-64.5% depending on smoking status. 
According to a recent paper the use of population 
based reference intervals has a significance, when 
single measurements are considered valid, if the l t is 
greater than 1.4 [28], In the present study f was 
from 1.4 for non-smokers and 1.2 for passive 
smokers and 2.2 for smokers (Table 2). However, 
population based reference intervals may only have 
an interest for non-smokers and passive smokers, but 
not for smokers. 

In Table 3 both the IFCC reference interval and 
the IUPAC recommended coverage intervals are 
given. The coverage interval has some statistical 
advantages over the IFCC reference intervals, e.g. 
being a prediction interval (i.e. it can be used to 
predict whether single future observations will be 
covered by the interval with a defined probability) 
[15]. In this study there is a good accordance 
between the limits calculated by the two methods 
(Table 3), which indicates that the number of 
samples are sufficient to estimate reliable reference 
limits. To avoid overestimation of excretion of 
cotinine from exposure to environmental tobacco 
smoke morning samples of non-smokers were select¬ 
ed in order to estimate a coverage interval. All 
smokers were above the upper reference level. The 
smokers excreted from 10 to 100 times higher 
amount of nicotine metabolites compared with pas¬ 
sive- and non-smokers (Fig. 1). Three former smok¬ 
ers had concentrations of nicotine metabolites at the 
same level as smokers. The high values could be due 
to miss information in the questionnaire regarding 
smoking or use of chewing gum or patch containing 
nicotine. Due to the lack of precise information 
given in the questionnaires they were excluded from 
the data analysis as outliers. 


Wide variations in cotinine concentrations are seen 
in comparable studies of non-smokers. The wide 
variation in excretion of nicotine metabolites in non- 
smokers exposed to tobacco smoke less than 25% of 
the day may be the intake of beverages. Some 
beverages derived from the plant Solanaceae, e.g. 
potatoes, tomatoes, eggplants, and some tea contains 
small amounts of nicotine [29]. No gender differ¬ 
ences could be demonstrated for non-smokers, pas¬ 
sive smokers, and smokers in the present study. 

In conclusion a reference interval according to 
IFCC and a coverage interval according to IUPAC 
for excretion of nicotine metabolites in non-smoking 
population were established for use in risk assess¬ 
ment of exposure to passive tobacco smoke. A RIA 
method for determination of nicotine metabolites was 
compared to a GC-MS method for determination of 
cotinine. Finally, it was demonstrated that the RIA 
method was adequate for clinical use in the assess¬ 
ment of exposure to tobacco smoke. In general non- 
smokers, passive-smokers, and smokers showed in¬ 
creased concentrations in the afternoon and evening 
samples compared to the morning samples. 
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